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The project evaluated here, funded under Title I of 
the 1965 Elementary Secondary Education Act, operates in a framework 
which utilizes the services of a reading consultant in target 
schools* It serves children who have been identified by their 
classroom teachers and school principals as experiencing difficulty 
in mastering reading. It provides master teachers and educational 
aides who furnish individual and small group instruction on a daily 
basis. Program procedures also utilize certain key components which 
include: wide range of alternative instructional techniques, variety 
of reading materials, feedback to classroom teacher, and, parental 
involvement. Key findings indicate that the services of the prpgram 
during 1972--73 produced a significant improvement in the reading 
performance of children who participated in the program. Children 
receiving consultant services in grades 1, 2, and 3 reflected higher 
scores on vocabulary and comprehension tests than their controls. 
Such differences were not statistically significant, however. 
Greatest impact was observed at grade 3 where experimental pupils 
achieved an advantage over control pupils in word and analysis, oral 
reading, use of compre,hension skills, and acceptance of the reading 
task responsibility. (Author/JM) 
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I. INTRODUCTIOa 

A. Needs and Rationale 

Schools sein/ing areas where uncmploNinent figures 
are higliest see greater concentrations of disadvantaged 
children from lioines v;hore illiteracy levels and economic 
deprivation exist. The prime challenge for these schools 
is to implement instinctional strategies wiiicii will 
enhance learning opportunities of these children in the 
communicative processes. Population transiency occurring 
throughout large urban cities is reflected in the increased 
number of adjustment pressures wiiicii faces the pupil at a 
time when needed skills for success in school are being 
developed. The Reading Improvement Project represents 
an attempt to provide specialized reading instruction 
and support for disadvantaged pupils at a time deemed 
critical in their school experience the primary grades. 

The project operates in a framework which utilizes 
the services of a reading consultant in target schools. 
It serves children who have been identified by their 
classroom teachers and school principals as experiencing 
difficulty in mastering reading. It provides master 
teachers and educational aides to furnish individual and 
small group instruction on a daily basis. TJie philosophy 
of the project emanates from the belief that the ability 
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to read is the key to, educational and vocational 
opportunity, whicli is the right of every child. 

Program procedures utilize certain key 
components which include: 

1. diagnosis of pupil reading needs 

2. individual and small group instruction on a 
daily basis 

3. wide range of alternative instructional 
techniques 

4. variety of reading materials 

5. feedback to classroom teacher 

6. parental involvement 

7. services of a master reading teacher 

8. services of an educational assistant 

B. Historical Background 

The project was funded initially under an Office of 
Economic Opportunity grant in 1965 which provided part-time 
services to 65 eligible schools. Evaluation of program 
services indicated greater concentration rather than disper- 
sion of services v;as required if an impact on reading per- 
formance were to be achieved. 

With tlie transfer to Title I funding in February, 
1967, services were focused at 20 public and five non-public 
schools with the highest concentrations of disadvantaged 
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pupils. Al this time, an important redirection in services 
involved titc transfer of certain insorvicc components sucii 
as demonstration teaciiin5: and consultation for classroom 
teachers to otiicr fund inn sources wiiich provided in^oi ec ts 
tandam to the Reading Instruction Project. In keeping; with 
the s]urit of Title I lev^islat ion; activities centered 
primarily on ser\'ices to disadvantaj^ed cliihlren. 

Summary of Operations 

Project services during tlic 1972-73 school year were 
provided to a total, of l,9iU impils in grades one, t\vo and 
three, in 51 pub 1 ic and 10 non-publ ic sciiools idcnt if icd as 
eligible for Title I services, based on tiie January 1st 
census. Total staff needs for the in^ogram included 56 full 
time consultants and 20 ecucational assistants in addition 
to administrative and clerical staff. Through efforts of 
the staff, program enrollees demonstrated greater average 
reading gains than did their controls. 

Total expenditures for the project wore $745, S47 
excluding custodial costs. Cost data indicate ci per pupil 
cost of approximately 5575.60 for the project during the 
school year 1972-75 based on a service rate of l,9i)l pupils. 
During tiiat current operation period, per pupil expenditure 
for instruction in tho elementary grades of the Cleveland 
Public Schools totaled S518.69*. Approximately thirty-six 
per cent of total instruction time is devoted to reading 
instruction. Cost of the instructional time allocated to 

*General Fund - Per Pupil Educational Expenditures 



reading was approximately $1S6.75 per child in tlicse grades. 

Per pupil cost of the project (less custodial 
costs) was approximately $575.00 for the 11^72-75 year. 

Data show tliat control children made an average 
gain of .7 units in vocabulary and •S grade equivalent units 
in compreliension for an operating fund expenditure of $1S6.75. 

Til is pro j ect increased progress of experimental 
pupils by an average of 1.5 units in vocabulary and 1.0 
units in compreliension. Consequently, the additional 
increment of ,6 and ,5 grade equivalent units in each area 
cost $575.60. This finding suggests tliat for each unit of 
incremeiit in comprehension, cost will be approximately 
$74.72 and for vocabulary $62,26. 

The program closed with service to 41 public and 
non-public scliools. 

D. Questions To Be Answered By Evaluation 

This evaluation focuses on the services of the 
Reading Instruction Project provided during the school 
year 1972-75. It draws substantially on information from 
the 1969-75 reports to provide study of the longitudinal 
effect of the project. 
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The evaluation considered tl\e following questions 



related to the assessment of the effectiveness of services 
provided by this project:- 

1. Docs the readins^ performance of children receiving 
consultant service differ from chi Idren not receiving 
consultant service in terms of standardized test 
results, tcaciier rating of various aspects of class- 
room reading performance, final mark in reading and 
attendance? 

2. How many pupils improved their reading skill so that 
they could be considered to be performing at an 
appropriate level? 

3. What were teachers' perceptions of pupils progress? 

4. What were parents* perceptions of pupils progress? 

5. How does the current progress of pupils who received 
service in 1969-72 compare with those who did not 
receive service? 

6. How did teachers view the project at its present 
stage of operation? 



'Si 
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II . HIGld.IGllTS OF FINDINGS 

A.. Summary Of Key Findii^n.s 

Findings indicate tiuit the services of the 
Reading Improvement Pronrain during 1972-73 produced a 
significant iin-rrovement in th.o rcadiiir. performance of 



cliildren who participated in the urogram. Cost data for tiie 
project revealed a [)er pupil expenditure of S575.60 during 
the scliool term 1972-75. The results from two designs were 
used in tlie analysis of data. 

1. Children receiving consultant services in qrades one, 
two and tiiree reflected nigiier scores on vocabularv 
and comp,rchension tests than their controls. Such' 
differences were not statistically significant, however: 

T/u-;LE I 

Gates MacGinitic Readinj^ Tes ts 
Primary A, Form 1 

Primary B and C, Fom 2 



Comparison of Posttcst Scores for Experimental 
and Control Children in Grades 1, 2 and 5 





VOCABULARY 




Grade 


Experimental 


Control 


1 


1.8 


1.6 


2 


2.9 


2.5 


1 
«./ 


5.4 


3.0 




C 0 M P R E 1! E N S I 0 H 




Grade 


Experimental 


Contro 1 


1 


l.S . 


1,6 


2 


2.6 


2.4 


> 


3.1 


2,7 



(Raw scores were converted to j^rade equivalent units for tlie purpose 
of this table.) 
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Averar.o j^ains dcccrminod in dosii^n rwo revealed that 
cx;^e]'iinoiu;ai pujui.^?' nrop,rcsrs iiau exceeded Viuit of 
controls in '.•'.7'ade.s two aiui throe l^ised uiion vro and 
post test measures. Hxperinventn 1 pupils deip.ons trated 
an averap.e ctain ol* one and one-fourtn months ii; 
vocabulary Tor one inoiith of instruction :ind sli<;htly 
better than one :aoiiti» in coinpreiicns.iou . Controls 
reflected sJij^,irci>' less t;Kin one month, of uain for 
one month of instruction in vocahukn-y and slip,htl>* 
better tiian tv.o-tivirds of a luontii in conr;]*ehension 
for tile sai:ie period of instruction. 

TAiJJdi II 

Gain Scores 
hA|^erii:>en Va 1 - Control 
Gates MacGini tic ;\eadin|.- Tests 
Primary B and C, Horm 2 





Vocabu L'ir>' 






Compre'ncn 


si on 


Grade 


lix.ieriinon taJ 


Contro] 


Gr:i do 


l:x:)cri]nenta 


.1 Control 




1 . 50 


1.00 


') 


1.00 


.SO 


3 


1, LM ) 


.70 


3 


.'JO 


.SO 



(iroup Av'i , I . 2:j liroup Avf^. . ,Vi:> . oS 



3. Greatest impact was observed at ^^radc three where 
experimental pui)ils aciiieved an advantage over 
control pu[)ils in word analysis, oral readin?^, 
use of comprehension skills and acceptance of the 
reading task responsibility. This rcpreseiited a 
significant program effect. 

4. Approximately 73 per cent of second .crradc pupils 
and 34 per cent of third j^radc pupils nad placed 
within a half year of their reading expectancies 
after one year of treatment. (l-)71-72 results 
reflected 48 per cent of experimental pupils 
having up-graded their reading performance so 
that they placed witiiin a half )'car of their 
reading expectancies and 58 per cent of third 
grade pupils in t\\o experimental group having 
achieved this status. The 1970-7J study revealed 
49 and 50 per cent standing at tlie apprc]^riate 
level, 1969-70 results reflected 49 per cent 
and 38 per cent rate of improvement in these 
grades , ) 
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5. Teachers viewed tiie strenjjtlis of the prop^ram as 
includinp, individualir.eu attention to the child ^s 
specific rendiiyc; needs, inprovod )vi I lin,t^])ess oTrThe 
part of pupils to participate in the reading oro u-) and 
increased confidence in reading . 

6. Approximately 68 per cent v:f the parents rated t!ie 
program as helping their child "very much". 

7. Parents valued the interest their children showed in 
reading. Tliey reported a^'preciation of the opportunity 
to share in the cliild's reading. Parents in tlus year's 
survey reported noting an increased interest in their 
own reading. This, t'ney indicated was due to the child's 
reading of newspapers and magazines at hOiiie and partici- 
pating with tliem in discussions of tiungs read. 

Proj ect records show a total of 1 , 279 parents involved 
in the program ciirough group meetings, individual 
conferences, classroom visits and 'nome visitations. 

8. Tiie longitudinal study of third grade pupils who 

had participated in the project and were in the sixth 
grade in 1975 revealed the experimental group per- 
fonning significantly iiigiier than control pupils i:i 
comprehens ion. The di ff erence was statistical ly 
significant . 

Samples of tliird grade pupils [prior particij^ants, 
1971-72) whto participated in t!ie fourth grade 
administration of the Comprehensive Tests of Basic 
Skills and fifth graders (prior participants) v:ho 
participated in the Stanford Diagnostic l^eading 
Tests reflected the regression phenomena . No 
significant differences were observable between 
tlie performances of experimental and control pupils 
in the two samples . 
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l !ir^)li cat ions and I- ecommenda tions 

The Reading Improvcmcni Program has been efficiently 
implemented and appears to be accomplishing its stated objectives. 

Evaluation findings from test data ref 1 ec ted no sig- 
nificant differences between experimental and control groups 
at either of the primary grade levels in coni])reheT\sion. This 
fiiKling suggests a need for more information on the kinds of 
treatment controls are given and intensive communication 
between teaciiers and consul t ants in the identification of 
pupils who require the services of this project. 

At tiie third grade level boys appeared to perform 
better in those areas within the reading process which teachers 
fnay subjectively consider indicators of pupil progress in reading. 
This pattern may suggest a break-through in the project's 
history, should it continue. Within tlie overall population, 
the larger percentages of participants at any given grade level 
have been boys. In prior years* evaluations, boys lagged in the 
specific areas of tiic reading process as observed by classroom 
teachers. Tl^e project implemented in-service to teachers in 
an attempt to foster greater understanding of the differences 
in rate of developmental growth between boys and girls. 
* Exploration of and introduction of materials oriented equally 
to boys and girls was an integral part of the plan. In-service 
to staff in those aspects of ciiild development deemed appro- 
priate to reading needs of pupils was fostered. 

Parents, teachers and principals have recommended 
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that the successful reading experiences of the primary 
cliildrcn be extended to their off-spring in the elementary 
grades. It has boon demonstrated that one out of tv:o pupils 
in grades two and throe vs'ho placed at an appropriate reading 
level, tend to remain below average in reading performances 
of pupils in these groups. As they progress through t)ie 
later grades witliout structured reading remediation efforis, 
grovvth effects in reading dissipate. Current and ])rior 
year reports from principals, parents and teachers in schools 
where the program has operated indicate feelings that services 
to pupils in grades four, five and six should be provided. 

it is recommended that the services of the Reading 

Improvement Program be continued to pupils in tiie Cleveland 

sciiools . 1 1 is suggested, based upon evaluation findings , 

parental opinions, and interviews of sc'nool personnel that 

the project miglvt wish to explore; 

a review of the selection process for all parti- 
cipants at the school level. 

greater emphasis on reading comprehension 

improved communication v;ith teachers of pupils 
participating in the program to accomplish 
grea.ter understanding of the program, its 
methods of ]-)upi.l selection and feedback. 

It is further recommended that the Reading Instruction 

Program consider utilization of the experiential learnings 

gleaiied from the Reading Improvement Primary program as a 

base for tiie development of a program of services for fourth 

grade pupils. 
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III. PROjnCT DliSCRlPTION 

A* Participant Ciharactcristic ^:* 

Hnrollmcnt data for the project indicated that 

a total of 1,991 pupils participated in the progranu 

Pupils were distributed across the following grade levels: 

TABLi: III 

DISTRIBUTION OF PUPILS BY GRADHS* 
READING IMPROVHMiiNT Pl^.OGRAM 
1972-1975 



Public Non~Public 



Grade 


Boys 


% 


Girls 


0. 

'o 


Total 


Boys 


% 


Girls 


a, 

'0 


Total 


1 


265 


59% 


178 


40% 


443 


25 


74% 


9 


27% 


54 


2 


369 


58% 


265 


42% 


654 


50 


57% 


58 


43% 


SS 


3 


405 


56% 


312 


44% 


715 


39 


51% 


38 


49% 


77 


Total 


1037 


58% 


755 


45% 


1792 


114 


57% 


85 


43% 


199 



*i:xpcri mental Pu[)i Is 

Approximately 58 per cent of tl\e total pupil enrollment 
were boys. Enrollment was distributed between tliree grade 
levels, witii approximately 22 per cent being tlurd graders, 15 
per cent first graders, and 21 per cent second graders. Boys 
accounted for 58 per cent of project enrollment in the public 
schools and 57 per cent in the non-public schools. Girls 
represented 42 per cent of ti\e total pupil count in public and 
43 per cent in non-public schools. 

Average scholastic aptitude scores for the pupi 1 
groups, which were obtained from the Lorge-Thorndike 
Intelligence Scale, placed the groups in the below average 
range. Average P. L.R. scores included: 

. 11 - 
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RESULTS OF SCilObVS'l'IC APTITUDli TliSTS 
1972-1973 
Cognitive Abilities Test 
Level 1, Form 1 - Grade 1 
Primary II, Form 1 - Grade 2 
Lorge-Tliorndike Intel li gence Tests 
Level 2, Primary Battery, Form A 



Group Boys Gi rls Summary 

lixp ,^ Con . iixn . Con . l:x)> . Con . 

Grade 1 84.52 78.75 77Tts 73TTs SOTiM 76TTT 

Grade 2 82.27 80.40 SO. 07 79.19 SI. 17 79.80 

Grade 3 S9.68 90.28 87. 10 89.30 88.39 89.79 



Median ages for the respective grades exceeded typical 
median ages by 6 to 16 months. Chronological age distributions 
for ecLcli grade were: 

TABLE V 

Median Chronological Ages by Grade 
1972-1973 



Group 




Range of 


Ages* 




Median Age 








Experimental 


Control 




Experimental 


Control 


Grade 


1 


6- 8 - 9-7 


6- 6- 9- 


8 


7-6 


7-7 


Gra de 


2 


6-11 - 9- 9 


7-0 - 9- 


8 


8-0 


8-3 


Grade 


3 


7-10 - 10- 5 


7-11- 10- 


3 


9-1 


9-0 



*years and months as of September, 1972 
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Project records were checked to determine the pattern 
of criteria used by i)rincipals and teachers for identification 
of pupils for referral to tho program. The major criterion 
used either singly or in combinaticri with other criteria 
appeared to be judgment of teacher and principal after 
observation of classroom performance. The incidence of 
referral is summarized as follows : 

TABLE VI 



REASON FOR REFERRAL 



Referral Reason* Grade 1 Grade 2 Grade 3 Total 



Grade Retardation 


111 


210 


248 


569 


Perfoiinance^ below 
expectations on 
standardized tests 


155 


167 


201 


503 


Cumulative record of 
poor school achieve- 
ment 


86 


249 


380 


715 


Below average perfor- 
mance on a standar- 
dized scholastic 
aptitude test 


58 


67 


110 


235 


Judgment of teacher 
§ principal after 
observation of 
classroom per- 
formance 


272 


' 360 


445 


1,077 



*Duplicated counts 
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I>. Project Operatio ns 

The project began its 1972-75 operation at 59 ele- 
mentary schools. During tlie year, two additional schools 
entered the program. At the end of tlic scliool year, the 
project was rendering service to pupils in 51 public and 
10 non-public elementary schools utilizing a staff of 66 
persons. Guided by the educational program manager, staff 
included an assistant, 5b consultants and 29 educational 
assistants . 

Pupils were identified on the basis of program 
criteria by teachers and principals of eligible target city 
schools. Project administrative staff aided by the Division 
of Research randomly assigned pupi Is to service groups from 
the referral lists. The numbers of cliildren identified 
necessitated ai". assignment procedure which provided all pupils 
with an equal opportunity for service. In addition, random 
assignment established control of extraneous variables other 
than reading instruction which might account for changes in 
reading performance of the children. Children not randomly 
selected, but recommended, were placed on a waiting list for 
future assignment as more staff became available to the project 
Staff shortages necessitated a waiting list of pupils who 
became the project's controls and moved into the experimental 
group as experimental pupils transferred or withdrew to other 
cities. Random selection procedures provided a fair means of 
allocating services inasmuch as more children were identified 
for services than could have been served with program resources 
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Enrollment records for the {jropram show that 1,991 
pupils had been served as of June 1, 1973. The larger enrol lee 
increases occurred in October (two per cent). In addition, 322 
pupils who were referred by their teachers and j^rocessed for 
service in September remained on the waiting list in Juno, 
1975, as additional staff was not available during the year. 
In accordance with the design of this program, pupils remaining 
on the waiting list are the project's controls. 



T/VBLI: VII 

Participant Entries by Month 1972-1975 





Sept. 


Oct. 


Nov . 


Dec. 


Jan . 


Feb. 


Mar. 


Anr. 


Total 


Grade 1 


455 


20 


9 


9 


8 


2 


5 


1 


477 


Grade 2 


MS 


10 


15 


6 


10 


12 


9 


4 


722 


Grade 5 


111 


15 


5 


10 


11 


10 


9 


5 


792 


Totals 


ISOS 


45 


27 


25 


29 


24 


21 


10 


1991 



Pupils placed in the program were scheduled in cadres 
of six to ten for 50 minutes of daily instruction. Pupils 
received an average of four and ono-lialf hours of instruction 
each week. Appendix I contains a summary of target schools 
involved and number of pupils on the service list ending 
June, 1975. Of the 1,991 pupils served during t}\e school 
year, 157 were enrolled in non-public schools. Reading 
consultants met a total of pupils ru.\ging from 56 to 50 
each day. 

Consultants attempted to gear daily instruction to 
needs of pupils in the particular group. The general plan 
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followed by consultants usually involved four types of pupil 
activity : 

1. warm up sessions reinforcing previously taught 
skills 

2. skill presentation sessions 

3. oral and silent reading opportunities 

4. individual development sessions providing 
one-to-one tutoring 

In addition, conference time for motivation and feed- 
back of progress to pujn 1 was a part of the daily sc'nedule. 

Consultants varied activities to keep pupil interest 
high, provided individualized and small group instruction witli 
different approaches to stimulate reading growth. Materials 
of high interest level were used. Consultants designed reading 
games, charts, worksheets, illustrative materials in addition 
to utilising the latest commercial materials and media. 

Each consultant attempted to employ instructional 
strategies which would provide children successful experiences. 
On-going feedback to children was utilized to make them aware 
of progress. Generally, instruction sought to improve vocabu- 
lary, skill in following directions, mastery of sight words, 
grasp of vocabular\" skills, and techniques in selecting main 
ideas augmentc,, with emphasis on critical thinking. 
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In all target elementary schools serv'ecl, sessions 
were scheduled in a room assigned to the consultant. The 
room was made available as an in-service resource center for 
primary grade teachers. Liducational aides assisted consul- 
tants in record keeping, cl erica 1 tasks , and tutorial acti- 
vities as well as supervising the arrival and disir.issal of 
pupils in the reading resource center. 

Records of 1,991 pupils receiving service as of June 
1975 show 1,042 parental classroom visits, 1,159 individual 
conferences and an attendance of 712 parents a-t group meetings. 
In addition, a total of 55 home visits was made by consultants. 
Estimated total unduplicated involvement of parents was 2,044 
in tliesc activities. Consultants discussed pupil strengths 
and weaknesses with parents and recommended procedures which 
might be adapted for home use in reinforcement of the reading 
program and encouragement of pupil progress. Meetings featured 
demonstrations of reading techniques witii children in whicii 
parents could obser;c their own children. Consultants shared 
suggestions for reading activities with parents and outlined 
the availability of library materials in the school and 
community. 

The staff spent 1,954 hours in in-service activities 
ranging from local workshops to national conventions and reading 
institutes. A total of 62 staff members completed 122 hours 
involving teacher and teacher aide training while 91S hours 



ERLC 



- 17 - 



were utilized in worksliops. Tlie i^emaining hours of in-service 
included programs by local administrations and participation 
in national conventions and reading conferences. 
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EVALUATION 

A. Basic Design 

The evaluation plan attempted to assess change in 
the readin^t; performance of pupils receiving program 
services and to compare this change with that of control 
pupi Is . 

An analysis was designed involving measurement of 
changes in reading performance of experimental and control 
pupils. Design for the analysis followed a 2 x 3 x 2 model 
involving factors of sex, grade and teatment. Multi- 
variate analysis of covariance was applied to data. 

The sample numbers (a total of 678) involved in 
the analysis at the three grade levels is summarized below: 



T/VBLH VIII 
Sample Population By Grade 



Grade 


Group 


Hxperimental 


Control 


Total 


1 


Boys 


59 


40 


99 




Girls 


29 


21 


50 


2 


Boys 


67 


75 


142 




Girls 


61 


52 


113 


3 


Boys 


78 


88 


166 




Girls 


61 


47 


108 




Total 


355 


523 


678 



Data for the multivariate analysis included 
scores on standardized tests of word meaning 
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and paragraph meaning with covariates of P.L.R, scores, 
chronological and attendance. 

Data used for the multivariate analysis included: 

covariates: P,L,R. scores 
attendance 
chronological age 

, dependent variables: 

vocabulary test score 
comprehension test score 
rating on use of classroom 

reading materials 
rank in class in tcr:ns of 

overall reading performance 
final mark in reading 

Multivariate analysis of covariance was con- 
sidered appropriate for this evaluation where measurements 
of several variables were obtained from the same pupil 
groups in disproportionate subclass numbers. This 
approach takes into account dependencies existing between 
these variables. 

It deals with correlations between variables, 
uses a single probability statement applicable to all 
variables jointly, and is based upon a known exact sampling 
distribution from which the required probabilities can be 
obtained. Differences between treatment effects can be 
inspected to determine the direction and relative size 
effect on each dependent variable. After test of main 
effects of the variables is accomplished, step-down tests 
allow for investigation of dependent variables .in an 
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ordering chosen by the investigator to determine effects 
of more critical variables. Univariate procedures would 
not deal with the correlations between variables nor 
produce statistically independent tests. 

An effort was made to obtain observation of pupil 
reading performance from the standpoint of the pupils' 
classroom teachers. Classroom performance information in 
the form of reading marks, use of classroom reading 
materials, and rank in classroom was obtained for 354 
experimental and control pupils. 

A second pliase of the evaluation of changes in 
pupil reading performance involved an individual - vs - 
self comparison whereby pupil gain was measured against 
pupil's reading expectancy. An objective dimension was 
introduced in the form of a reading expectancy, as 
computed by the Bond-Tinker formula, to determine pupil 
progress toward a reading performance level relevant to 
the pupil's scholastic strength. 

A third phase of the evaluation centered on the 
progress of previously served pupils as described by 
reading test scores obtained through the city-wide 
testing program. 

Parents were requested to complete questionnaires 
which were returned to the Division of Research and 
Development by mail. A total of 222 replies was received. 
This represented a response from 52 per cent of parents of 
pupils in the evaluation sample. 
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B, Main Findin^^s 

As established by the intent of the project, 
change in reading performance was compared for pupils who 
had received services of the reading consultants and those 
pupils who had been identified for service but not selec- 
ted by random assignment procedures employed in the 
program (control). 

Does the reading performance of children 
receiving consultant service differ from 
children not receiving coiisultant: service 
in terms of standardized test results, 
teacher rating of clcissroom performance, 
and final reading mark? 

Certain comparisons were considered essential to 
determining successful attainment of program goals* 
Multivariate analysis facilitated comparison of perfor- 
mance of experimental and control groups in terms of 
these contrasts: 

1 * experimental versus control 

2. boys versus girls 

3. grade level 

4. interactions between factors 

Results in which significant differences were 
noted are discussed below. Significant results were 
obtained in four of the twelve contrasts attempted. 

In line with recent trends in researcii, the five 
per cent level of probability (p. <.05) was selected for 
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statistical tests of sigiiif icaiicc (t tests) for this 
evaluation to give rcasonab le assurances that tlie nul 1 
hypothesis would not be rejected unless it really should 
be.l 

a, Hxperiinentnl vs. Control Performan ce 

A sip,nificant difference between tiic per- 
formances of experimental and control 
pupils appeared in oral readinr, , a teacher 
ra t X ng it em , Nea r - s 1 gn i f i c ant 1 ev e I s were 
apparent in confidence i n readi ng ; use of 
classroom materials and independent reading . 

A multivariate F- ratio of 1.9070 comparing experi- 
mental pupils witli controls indicated a statistically signi- 
ficant difference at the .0152 level of probability. In the 
presence of tiiis significant multivariate F-ratios and proba- 
bility levels relative to experimental and control perfor- 
mances may be observed in the a])pendices. 

Inspection of the "least squares estimates", \v'hich 
are statistical indicators representing differences between 
groups, reflected higiier performances by experimental groups 
in oral reading and teacher marks . Controls exceeded in 
reading confidence , i r.dependence and use of classroom materials , 

b . Contrast of Performance of Boys vs. Girls 

(1) Within the total population, teaci\ers 

assigned nigher marks to girls. Teachers 
reported greater participation in reading, 
confidence in reading and independence 
observed on the part of girls. 



^ lid ward V/. Minium. Statistical Reasoning in Psychology 
and Education. New York. Jolm Wiley and Sons, Inc. 1970. P. 259. 
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(2) Boys impressed their teachers \/rzU appli- 
cation of techniques of word analysis and 
facility in responsihilit)' to li\c rcadinu 
task. Higher ratiiigs were assigned to 
boys than girls whether experimental or 
control. These ratinr^s approached near- 
significance. 

In this contrast tlic multivariate F-ratio of 4,4595, 
comparing the performances of boys and girls, indicated statis- 
tically significant differences at the ,0001 level of proba- 
bility. The "least squares estimates of effects" documentated 
the group which evidenced the superior performances, Tiiese 
superior performances appeared in tl\e areas of teacher 
opinion and reported in teacher ratings, 

c. Com]^arison of Performance Grade One 
vs. Grade Three 

Grade three pupils perforn^ed better in word 
analysis , knowledge of si^^ht words , oral 
reading and use of comprcneusion skills 
according to classroom teachers. 

Grade comparisons in this evaluation relate to 

teacher ratings of observed pupil reading performances on 

the teacher rating scale. 



"Least squares estimates of effects" documented 
the higher ratings assigned these pupils by teachers. The 
summary of this contrast may be viewed in the appendices. 

It might be interpreted that those are "expected" 
differences influenced by maturation. It must be kept in 
mind that tiie sample was composed of pupils whose range of 
talent was restricted and whose history showed them to have 
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exhibited low reading function tlirougli the grades prior to 
referral for treatment, 

d . Com]Kirison of Pui)ils in Grade Tw o 
vs , CiraJe 1 nrec ^ 

Pupils in j',rade two made better use of classroom 
materials and received better teacher marks tiian 
did their third grade counterparts . Second j:jrade 
pupi Is exhibi ted better at ti tudes toward readin,t^ 
reflected in the ratings teachers c^avc on 
completion of readii^ assignments, 

A multivariate F~ratio of 36,45S1 for IS and 044 

degrees of freedom signified a statistically significant 

difference at the .UOOl level of probability, 

"Least squares estimates'' confirmed these differences 
in favor of second grade pupils. 

e. Interaction Between Sex, Grade 
and 'I'reatment 

A statistically significant advantage appeared 
in the interaction of sex, grades 1-5 and 
experimental versus control pupils . Ubs er- 
vation of the ^'least squares estimates of 
effects" revealed this advantage to be in 
favor of grade three boys. 

A multivariate F-ratio of 1.4590, probability level 
of .0985, was considered indicative of the presence of a 
statistically significant interactioi\ within this hypothesis, 

Inspectioi\ of the "least squares estimates" reflected 
the favorable image boys of grade three gave to their class- 
room teachers. Teacher ratings of pupil performances sliowed 
boys of tiie experimental group demonstrating i\ig)ier levels 
of reading process than girls in word anaylsis, acquisition 
of sight words, oral reading, use of comprehension skills 
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and acceptances of the readinr, task responsibility. This 
represented an emerging direction not observable in prior 
years * evaluations . 

The correlation matrix was examined to observe 
the relation between use of classroom materials and final 
marks assigned pupils in reading. A correlation ratio of 
.400 existed. It may be interpreted that a strong relation- 
ship existed between teacher marks in reading and teacher 
obsein/ations of the use of classroom materials by pupils in 
this sample. It would appear those items used by teacliors 
to rank pupils in the classes and tiiose used to rate the 
improvement of pupils in rcciding were predictors of tlie 
marks pupils received . 

Further study of the correlation matrix reflected 
moderate correlations between teacher ratings of pu]")il 
imj)rovement and attained raw scores from vocabulary' and 
comprehension tests, .ISS to .248, (ratings vs. vocabulary) 
and .185 to .-255 (ratings vs. comprehension raw scores). 
Negative correlations existed between rank in class vs. 
vocabulary and comprehension raw scores. It may be inter- 
preted than an expectancy bias was operative in this compari- 
son. The combined mean of assigned teacher mark, 3.700 for 
experimental pupils and 5.967 for controls, fell within 
average range in teacher marks assigned pupils at the end 
of the year. 

Data obtained in the 1969 evaluation indicated that 
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that while teacher ratings generally were correlated (a range of 
,135 to .587 was observed between ratings) they were inversely 
related to results on standardized tests of vocabulary and 
comprehension. Tlie strongest negative correlations in the data 
were observed between final achievement mark and scores on these 
tests (-.'17 and -.41 respectively). The 1970 data indicated a 
dramatic change between vocabulary and comprehension test scores 
and readii^g mark, rating of the use of reading materials in tlie 
classroom and classroom rank in reading. Tlie range correlations 
were .589 to .468. The 1971-1972 study strongly reflected use of 
classroom materials in teacher assessm nt of pupil performances in 
vocabulary and comprehension. Tlie finding was substantiated by 
the correlation of .4450 between teacher narks and use of class- 
room materials. The 1972-75 study revealed a strong correlation 
between teacher marks and the use of classroom materials of .4596. 
The range of correlations between teacher marks and use of classroom 
materials in relation to the attained raw scores in vocabulary and 
comprehension tests was from .2412 to .5206. The correlation 
matrix is presented in Appendix VIII. 

Comparison of results from 1968-69, 1969-70, 1970-71, 
1971-72 indicates a similar superiority of experimental pupils in 
the three s^imples in terras of performance on vocabulary and compre- 
hension tests. Boys obtained higher reading marks "i.n the 1968 
analysis, while girls received higher marks in the 1969 and 1970 
study. No significant differences were observed in the area of 
teacher marks in the 1970-71 and 1971-72 studies. Experimental 
girls attained higher rank in class in the 1970-71 study wliile 
there were no significant differences in the 1971-72 study. 
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The 1972-75 evaluatioi\ continues the j-jattcri^ of superior 
pcrformaiKc on vocabulary and comprehension tests for experi- 
mental pupils. Gills received higiier marks. 

Appendix IV sunmiarizes i*-ratios and probability levels 

Patterns of final reading m:irks assipjicd by classroom 
teacliers indicate relatively few differences between the t;rou])S 
Witliin experimental and control groups teachers assigned t'ne 
highest percentage of grades as "satisfactory*' (S). 

Grade equivalent data were drawn from norms published 
in manuals of tiie Gates MacGinitic Heading Test Series. 

Comparison of the performance status of experimental 
and control pupils revealed: 

1 . Gra de Tliree 

Greatest difference was observed in favor of exj^erimental 
girls where the level of pcrformaiice was .7 grade equi- 
valent units iiigiier tiian the control group (5.0 vs. 2.9) 
in vocabulary. 

In comprehension, a .5 grade equivalent advantage was 
observed in favor of ex])erimental girls (5.5 vs. 2.8). 

Experimental boys reflected a two month grade equivalent 
advantage in vocabulary and comprehension wlien compared 
with their peers in the control groups (5.2 vs. 5.0, 
vocabulary, and 2.8 vs. 2.0, comprei\eusion) . , " 

2. Grade Two 

Experimental girls demonstrated a four month grade 
equivalent advantage beyond that of control girls in 
vocabulary and one inontii in comprehension. 
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Uxpcrimcntal boys in tliis sample achieved a tliree 
month advantai;c in vocabulaiy frradc equivalent mean 
scores and t\;o montiis in comprehension compared with 
control s . 

3 . Grade Ono 

Boys of t'^radc one exceeded tlieir controls in 
vocabulary performance . 

The advantage in achieved grade equivalent units 
was two nontlis beyond the aciiieved grade equivalent 
leveJ aciiicvcu by control boys, (l.S vs. !.()). 
Experimental girls lield a one month advantage over 
control girls (1.7 vs. 1.0) in vocabulary. 

Boys and girls in the experimental group reflected 

a two month advantage in compreiiension over control 

pupi Is . Contras ts were 1 . 8 vs . 1.6 (boys and girls , * 

experimental and control) . 

It may have been noted in the project description 
section of tiiis evaluation. Table IV, tliat the mean scholastic 
a])titude of experimental boys in tlie first grade exceeded 
that of control boys. Tlie difference was significantly 
different at p. / .US level of probal)ility , It would be inter- 
preted that in one out of twenty cases the difference would 
have been due to chance. It must also be recognized that 
scholastic aptitude was one of the covariates in the multi- 
variate analysis applied to sample data for tliis evaluation. 
Multivariate procedures made the necessary weighting adjust- 
ments and statistically eliminated the effect of this 
covariate upon any of tlie measures being tested. Results of 
the statistical test applied to the data may be viewed in 
the appendices . 
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Table IX mirrors the average final grade equi- 
valent SCO. s obtained by experimental and control groups 
in grades one, two and three. 



TABLE IX 



Average Grade Equivalent of Posttest Scores 
Gates MacGinitie Reading Tests 
F'rimary A, Form 1 
Primar)' B and C, Form 2 
Grades 1, 2, and 5 
1972-1975 



Grade 


Sex 


Vocabulary 
Experimental 


Control 


Comprehension 
Experimental Control 


1 


Boys 


1.8 


1.6 


1.8 


1.6 


2 




2.8 


2.5 


2.5 


2.3 


3 




3.2 


3.0 


2.8 


2.6 


1 


Girls 


1.7 


1.6 


1.8 


1.6 


2 




2.9 


2.5 


2.6 


2.5 


3 




3.6 


2.9 


3.3 


2.8 



Table X presents the means of raw scores with 
interpreted grade equivalent scores drawn from vocabulary and 
comprehension norms of the appropriate Gates MacGinitie Tests. 
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TABLK XIII-A 



Rcadin.t^ Improvement 
Pro-Fosttest Grade liquivalent Scores 
Based On Mean Raw Scores 
Gates MacGinitie Rcadinrj; Tests 
Primary B, Forms 1 and 2 Grade 2 
Primary C, Torms 1 and 2 Grade 3 
1972-1973 

Bovs Vs. Girls 



o in 
r3 O 

o 



Vocabularv 
4.0 
5.5 
3.0 
2.5 
2,0 
1.5 



(2.9) 



^.5 



Comprehension 
4.0 ' 
3,5 



3.0 
2.5 
2.0 
1.5 



f2.9) 



Pre 



^ost 



Pre 



Post 



u 

o 



4,0 
3. 5 
3.0 
2,5 
2,0 
l.S 




4..0 
3.5 
3,0 
2.5 
2,0 
1,5 



(2.9) 
/2'^2.S 



Pre 



Post 



Pre 



Post 



to 

o 



4,0 
3,5 
3,0 
2,5 



(5.0) 




•-^2.0* 



Pre 



\3o3.0 



Post 



4.0 



(3.9) 




Pre 



Post 



to 



4.0 
3 . 5 
3.0 
2.5 
2,0 
l.S 



(3.1) 



( 3.9) 
.9 



Pre 



Post 



4,0 




3.5 




3.0 


:3.o) 


2.5 


2.3*- 


2.0 


/.O 


1.5 





Pre 



(3.9) 




Post 
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TABLE XIII-B 



Comparison of Grade Equivalent 
Gain Units 
Grades 2 and 3 
Gates MacGinitic Reading Tests 
Primary B and C 
Form 1 (Pre Test) Forni 2 (Post Test) 
1972-1973 

Grade 2 



Vocabulary 



Coir.nrchension 



rnzLiruiiL/A i, 



1.5 



7ZZZZZZZZZZ3^ 



..0 



O csj O CO CTi O '-H CNi L.'/ "O CO o o 



Units of Gain 



Grade 3 



Vocabulary 



ComDrehcnsion 



1.2 



ijjjitinii 0.5 



0.9 



Units Of Gain 
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Reading Expectancy Comparison 

The second question of interest was: 

How many pupils iinrj roved ti\eir reading skill 
so tliat they could be coiisidered to bo 
performing at an apj)ropriatc level? 

Reading expectancies were determined for experimental 
pupils by the Hond-Tinker formula on a before and after service 
basis. The observed reading level for pupils was reported ia the 
form of a grade equivalent score for tl)e Comprelicnsion sub-test 
of the Gates MacGinitie Reading Test. TIio criterion fox assessment 
was set as tli e appropriate 1 evel of Func t ioning which was 
considered to b(^ within a half-year in t erms of a g ra dc placement 
score of the nunils* readin.t< expectancies. 

Comparison of grade equivalent scores in comprehension 
with reading expectancies indicated that 75 per cent of second grade 
pupils served in the program during the 1972-1975 school year 
placed v/ithin a half-year of their reading expectancies ♦ At least 
54 pel' cent of third grade pupils achieved this level of reading 
function. This information may be related to results obtained in 
evaluations from prior years which reflected percentages of gain 
as shown in Tables XIV-A ai\d XIV-B. These tables illustrate 
percentage changes from pre-program to post-program differences 
between perforn^ance levels in comprehension and reading expec- 
tancies for 1968-11)75 samples. 



TABLE XIV- A 



n 



Per Cent 

100 

SO 

70 

60 

50 

'10 

30 

20 

10 

0 , 
P. L. -2.1 aiio DO low 

Per Cent 

100 

SO 

70 

60 

50 

40 

30 

20 

10 

0 



P. I. 



Percentage of PupiJs - Various Pcrf ormarice 
Levels CoTiipared With Readinr; Lxpectancics 
1969, 1970, 1971, 1972, 1973 
Comprehension 



Grade 2 Post 



to 



a\ cr» 



wit 

"Ali 



ilii 



■I - o 



i 1 



Grade 2 Pre 




o 







oa 






1 






ii 






if 



2.U to -1.0 




O 

oo 



to 

o o 
a> o oN^- ^ 

h. I / i 



CO [//' 



mm 



-J .U' to - ,0 





within -.S and abo\ 



o 



o 



o 



to -1 



■1,0 to -.0 



within - . 5 :^nd abo 



2.1 and ueloK 

□ ^-"^^^ [|iiU 1-^70 ^ 1971 g 1972 ■ P. L. = Performance Level 
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T/\BLI: XIV- 13 



Per Cent 
100 
80 
70 
60 
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10 
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Percentage Of Pupils - Various Performance 
Levels Compared With Rcadini^ Expectancies 
1969, 1970, 1971, 1972, 1973 
Com])rchension 



Grade 3 Post 









M 


1 




1 










'2.0 to -1.0 



•2.1 and below 




-2,u to 



1.6 



o\* to 

• CO \0 c>P CnJ 

liil 



E^s"' to -I .i 



Grade 3 Pre 




-1.0 




I 

km 

■ 



witliin - .5 and abov 




I 1 1969 1570 ^] 1971 



1972 



197; 



■1.0 to 



P. L. 




within -.5 and abov 



Performance Level 
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It lias been determined tliat rcadinjj expectancies calcu- 
lated in the Bond-Tinker inetnod provide estimates that are very 
close to observed reading averages for various levels of scholastic 
aptitude. It was considered tliat children approaching tolerable 
differences (in these cases .5 grade equivalent score units) between 
performance levels and expectancies can be described as iuiving made 
appropriate improvement , ^ 

lixaminat ion of individual schoo 1 records in narrowing 
the discrepancies between performance levels and reading expec- 
tancies indicates t'nat 22 schools showed a substantial increase in 
the number of pupils reacliiiig an appropriate performance .level in 
reading. Four schools reflected a decrease in the number of pupils 
performing at tlic appropriate reading level. change was 

observed in 15 schools in this reading expectancy comparison. The 
combined decrease and no change patterns observed in the 19 schools 
may indicate that consideration should be given to a spring in- 
service session for teachers on selectiovi of participants for 
the project • It was apparent that the major reason used by schools 
for referral of participants was principal and teacfier judgment. 
Inasmuch as t'nis reason is dependent upon more subjective than 
objective elements related to staff judgement, some consideration 

should be given to whether or not nunils are oerforminE^ at their 
— — . ^ ^ 



"^Guy L. Bond and Miles A. Tinker. Reading Difficulti es : 
Their Diagnosis and C orrectiOi\ . New York: Applcton-Century- 
Crofts, 1L)07. 
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anti c i led reading expectancy leve J s when assignment to the 
referral list is m ade* In addition, staff changes and grade assign- 
ment changes are a nccxissary part of a city school operation, 
A spring in-service session on proper selection of students might 
serve as a refresher for some, acquaint otl.ers and clarify questions 
for those whose cx])eriences wit'n some pupils throughout the year 
have created air of: uncertainty regarding the expected pupil 
reading performances. 

It should also be recognizod ciiat residing expectancy is 
influenced by weak performance on the scholastic aptitude instru- 
ment used in the formula. Tl\e Bond-Tinker forinuin, however, has 
been demonstrated as "ovcrpredictin,r," performance for pupils at 
the lower end of tbo scholastic aptitude spectrum. Further study 
should be made of the relationship of tiie formula and performance 
in terms of various reading skills in the classroom, Tl\e formula 
provides another objective dimension to be used with staff judge- 
ment in identifying pupils for service. Appendices II and III 
summarize the pre and post program status of -pupils receiving 
service in terms of the comparison of reading performance and 
read i n g e x p e c t n c y . 

Te achers ^ Percepti ons of Progress 

.Another question of interest in the assessment of pupil 
progress involved the question: 
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What were tcacliors perceptions of pupil progress? 

Teacher ratings were returned for 355 experimental pupils 
and 325 control puj^ils in the sample. Observations about the 
functioning level in reading were considered important to 
assessing progress. Teachers were requested to rank pupils in 
relation to otiier children in their classes using a five-point 
continuum in answer to the guideline: 

From your knowlod?^c of this pupil's wor k in 
your class r oom > h ow w oiilu you rank tni^^ c'nilu ^ s 
over- a ll rccidinp, performance in ■roiaiion to tiie 
other chi luren in your class? ( visualizci your 
class as "iVo J ni; d i v i dad into f 1 fins ."j 

Results indicate slight differences between the over- 
all ratings of each group. Largest differences occurred at the 
lowest fiftl\ ranking in building sight words and acquisition 
of cojiiprchensicn skills. 



Lowest Second Middle Second Top 

Item Fifth Lowest Fj fth Fiftli Highest Fifth Fifth 



Word Analysis 


E 


10. 


7% 


27. 


.0% 


42. 


,8% 


15. 


.0% 


6 . 


.5^0 




C 


15. 


- 0, 
0-0 


24, 


.n 


39. 


9% 


13. 


,6% 


6. 


,8% 


Sigl^.t Words 


li 


S. 


0. 


22 , 


.5% 


44. 


,3% 


16. 


,9% 


7. 


.3% 


C 


17. 


3% 


IS, 


.3% 


57. 


,2% 


19. 


,5% 


7. 


,7% 


Oral Reading 


E 


14. 


9% 


22, 


.8% 


41. 


,7% 


14, 


,6% 


5, 


.9% 




/" 


17. 


6% 




,6% 


38, 


.1-0 


15. 


,5% 


6. 


.2% 


Compreiiens ion 


E 


30, 


.1% 


IS 


.0% 


38, 


.0% 


10, 


.1% 


3. 


/A 


Skills 


C 


6. 


5% 


33 


.1% 


41, 


.7% 


15, 


.6% 


4. 


.9% 


Participation 


li 


23. 


,1% 


25 


.1% 


30, 


.1% 


16 


" 0, 


7, 


.3% 




C 


51. 


.0% 


18 


, 0% 


21 


.7^6 


19, 


. 8% 


9 


.6% 
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Teachers \s'ere also requested to answer tlie question: 

In your opinion, can this child liandlc the usual 
readint? materials used in iiis i^radc? 

A difference L^otwoen tlie categories assigned on a five 
point continuum was evident at the cateqory "sometimes*'. Teachers 
reported more purj^osefui use of classroom materials by 40,6 per cent, 
of experimental pupils as 0[)posed to 51.9 per cent of control pupils. 
Summaries of each groups rating included the following; 



Most of Not at 

Group Always the time Sometimes Rarely All 

Experimental 2.5% 10.4% 40,6% 41.7% 9.9% 

Control 1.9% 10.5% 31,9% 45.0% 12.7% 



A copy of the Pupil Rating Scale for experimental and 
control pupils is contained in Appendix IV, Teachers viewed the 
strength of the program as providing additional approaches to the 
reading process and an increase in creating pupil interest in 
reading. 

Parents Perceptions of Progres s 

The Reading Improvement Program sought to improve 
parental support of children's efforts to read. Questionnaires 
were distributed to 355 parents of experimental pupils, partici- 
pating in the program, A total of 222 was received of which 136 
concerned boys and 92 concerned girls as program participants. 
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Approximately 50 parents of first graders, 82 parents of second 
graders and 51 parents of tliird tirade participants responded to 
the questionnaire. Approximately 68 per cent of the respondents 
viewed the program as helping their child "very much". Percentages 
of response to the question: lias the program helped your child 
were distributed as follows: 



Very 
Much 

68.0% 



Some 



24.77% 



Very Little 



.45% 



Not At 
A1.1 

.90% 



N = 222 

Parents viewed the prograi: as productive of a **better 
^reader" but emphasized benefits to parents in that parents have 
become interested in reading. This is indicative tiiat the impact 
of the help pupils have received has permeated the home environment, 
Suggestions from this year's survey reinforce prior years ^ 
suggestions . Suggestions include : 

expansion of tiie program beyond the first 
through third grade 

more reading teaciiers 

more reading time in school 



Approximately 8U per cent of the parent sample reported 
that they observed their children reading more books at home. 
Questionnaire data indicated tliat 66 per cent of parents stated 
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that they observed their child in reading activities at school. 
Compared with a 75 per cent positive resi)onse on the 1908 question- 
naire and 7S per cent in 1970, this represents a substantial 
number of parents who observed their child in reading activities 
at school as documentation of parent conferences reveal 27 parents 
participated in teacher - cliild - parent conferences, nine 
attended five and one parent six such conferences. The increased 
length of instructional periods for program participants during 
the school day eliminated liome visitations witliin the scliool day. 

The same pattern for informing parents that their 
children were being served in the pi'Ogram emerged in the 1973 
questionnaire. Parents of I2U pupils indicated that they first 
learned about the Reading Improvement Program from their child; 
78 stated that they received a letter informing them of their child's 
participation in the program. Consultants notified 48 parents by 
telephone. Tiiese data compared proportionately with totals of 
58, 50 and 59 in the 1971-72 survey. 

The program promoted a massive program of parental contact 
during the 1972-73 school year to intensify its efforts at gaining 
support for the child's reading. The success of these efforts 
may be measured by project records showing a total of 1,042 parents 
conferences and attendance of 712 parents at project parent meetings 
held within individual schools (duplicated counr for this sample of 
parents) . 
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Follow - Up of llxpci'iineiital and Control Pupils 



The final question of interest to tlie evaluation 
involved: 



How does tiie current progress of pupils who received 
service from the prof^rain from lUoy-72 co mpare witflT 
those wiio did not receive service (controls)? 

The following groups were involved in the longitudinal 
follow-up study. 



1. 1971-72 experimental and control third ^^raders 
enrolled in grade 4 as of September, 1972. 

2. 1969-70 experimental and control second graders 
enrolled in grade 5 as of September, 1972. 

3. 1970-71 experimental and control tliird graders 
enrolled in grade G as of September, 1972. 

Scores from a sample of 99 experimental and 82 control 
pupils were located who were served in grade 3 (experimental) and 
those not served (control) during the 1971-72 school year. The 
performance standings of these pupils from sub-test scores of the 
Stanford Diagnostic Reading Test (Level 1) administered in 
September, 1972 were observed: 
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STAjNFORD diagnostic AVl:R>\GE RAW SCORES 

Level 1 Grade 4 

Adini nistcred 1973 



Sub-Tests 


Exp. 


G,E, 


Control G,E, 


t- ratio 


Decision 


Comprehension 


29,58 


2,6 


26,26 2.3 


2,7692 




c 

J « 


Vocabulary 


17,36 


2,1 


16,84 2,1 


, 6553 


n. 


S , 


Auditory 














Discrimination 


26,bS 




25.74 


,6258 


n. 


s , 


Sy 1 labicati on 


10, 65 




10, 28 


• 5946 


n. 


s. 


Beginning And 














Ending Sounds 


25,10 




22,86 


2,5111 




s. 


Blending 


21,32 




19,55 


1,4066 


n. 


s. 


Sound Recognition 


16,27 




12,57 


3,2948 




s. 


s = significant 


n , s , 


= not 


significant 









p 92!f:,05 = 1,960 d, f , = 179 

Post score standings of tliis sample of pupils in the Gates 
MacGinitie Reading Tests in June, 1972, reflected superior reading 
performance for experimental pupils. The t-ratio of 5,9228 was 
significant at p <,05 (1,960), 

In September, 1972, the standings of experimental pupils 
mirrored a significant advantage over control pupils in compre- 
hension based upon a statistical significant finding between 
scores attained in the comprehension sub-test of the Stanford 
Diagnostic Test, Experimental pupils held a statistically 
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significant position in beginning and ending sounds in addition 
to sound recognition. The directions of weaknesses of both 
experimental and control groups lay in vocabulary, auditory 
discrimination, syllabication and blending. 

Scores for experimental and control third graders who had 
participated in the 1969-70 program and were in grade six as of 
September, 1972, were obtained. High mobility rates throughout 
tlic schools reduced the population of experimental and control 
groups remaining in their home schools to 154. Gates MacGinitie 
scores for a sample of 108 pupils from this group were drawn 
from prior project records. Statistical measures were applied. 
It was determined that no significant difference was apparent 
between the groups at 106 degrees of freedom, p:^.05, (2.000). 
Examination of the mean scores for each group showed a grade 
equivalent average in comprehension of 2.2 vs. 2.0, experimental- 
control, stanine, 2. Performance levels from the Comprehensive 
Tests of Basic Skills, Level 2, administered in February, 1973, 
revealed a statistically higher performance level in reading on 
the part of experimental pupils at sixth grade level. Grade 
equivalent averages were 5.1 vs. 2.7, stanii»e, 2. At the p .05 
level of significance utilizing the t_ test, the significally 

higher judgment was based on a _t of 2.2333 at 106 degrees of 
freedom (2.000). In 1971 the overall general population was 
one year and nine months below the norms as established by the 
Gates MacGinitie Reading Tests, Primary C. Pupil performance 
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standings at sixth grade level (1975) placed this sample group at 
stanine 2 on the Comprehensive Tests of Basic Skills, compre- 
hensijn subtest. This standing was 3.1 and 3.5 grade equivalent 
units below the mid-year norm of 6.2, which was the point in time 
of administration of the Comprehensive Tests of Basic Skills. 
The observedly slight difference between the means of the two 
sample groups, 13.682^.) and 11.4615, might be considered v>unport 
that the two groups were similar in characteristics as liad been 
established by the criteria by wluch they had been selected in 
1969. It may also be interpreted that tliis sample of pupils 
will continue to progress with difficulty through the higher 
grades without some form of reading support. 

The summary of results is shown as follows: 



Avg. Avg. 
Raw Score Grade Av^. 

Year Test Grade Mean I£q. Si.a. t-ratio Decision 

1969-1970 Gates 3 14.45 E 2.2 2 .2009 n.s. 

MacGinitie 

Reading Test 14.22 C 2.0 2 

Primar)' C 

1972-1973 Comprehensive 6 15.68 E 3.1 2 2.2333 s. 

Test of Basic 11.46 C 2.7 2 

Skills, Level 
2 

N = lUS o .05 :^2.0U0 df = 106 

s = significant n.s. = not significant b=Experimental C = Control 
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Further observation of the table reflects the suj^erior 
performance of the experimental group. This finding may subjec- 
tively suggest that residual effects of project treatment were 
oj)erative to a degree. 

Evidence of the impact of the need for continued support 
for pupils was revealed in a study of second grade participants 
in 1971-72 Reading Improvement Program who participated in the 
administration of the Comprehensive Test of Basic Skills adminis- 
tered in April, 1973. Tl^ese pupils wore third graders in the 
1972-^75 scliool year and were identified for the services of the 
reading consultant in their schools. The sample included 55 
experimental and 45 controls. The t-ratio based upon scores 
from the Gates MacG\nitie Primary B testing reflected a statis- 
tically significant difference between the reading performances 
of experimental and control j)upils at the end of the second 
"grade (1971-72). Results from the Comprehensive Test of Basic 
Skills, Level 1, administered at third grade level, April, 1973 
for this sample group showed control pupils achieving an 
advantage over experimentals without achieving significance of 
difference on this instrument. Experimental groups placed in 
stanine four while control groups placed in the fifth stanine 
which may be interpreted as average performance. Score 
data included: 
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Avg. Avg. 
Raw Score Grade 

Test Grade Mean liquiv. Staiune t-ratio Decision* 

Gates MacGinitie 2 Fi 19.98 2.7 5 2.2S67 s. 

Reading Test, C 16. 7o 2.4 4 

Primary B 

Comprehensive 5 H 22.16 3.0 4 1.4052 n.s. 

Test of Basic C 24.56 3.2 5 

Skills 

N = 98 ^ 1). ^A)S = 2.U00 df = 96 

*s = significant n.s. = noc significant I:=i:xpcrimentai C=Control 

Examination of the findings reveal average test scores 
for experimental pupils in this sample were in stanine five on 
the second grade Primary B, Gates MacGinitie and stanine five 
after administration of the third grade Comprehensive Test of 
Basic Skills. Control pujuls of this sample who placed in 
stanine four increased their standings on the Comprehensive 
Test of Basic Skills to stanine five. 

The third longitudinal study was concerned with the 
diagnosed reading strengths and weaknesses of 1970-71 third grade 
pupils who were in tlie fifth grades of their home schools in 
1972-1973. The sample included 67 experimental pupils and 13 
controls. In June, 1971, scores from the Gates MacGinitie pupils 
in this sample showed a .6 grade equivalent advantage for 
experimental pupils over their controls in vocabulary and a .5 
grade equivalent advantage in comprehension. Results from the 
Stanford Diagnostic Test, Level II, administered in September, 
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1972, to fifth grade pupils reflected no significant differences 
between the groups in vocabulary or comprehension* It was noted 
tliat the experimental pupils demonstrated a performance advantai^c 
in vocabulaiy, on sound discrimination and reading rate on this test. 

Results are recorded for observation. 

STANFORD DIAGNOSTIC AVERAGE RAW SCORES 

Level II 
Grade 5 1972 



Subtests Hxp . Stanin e Con. Stanine t-ratio Decision 



Compreliension 


15, 


,94 


2 


14, 


,94 


2 




,5819 


n . 


.s. 


Vocabulary 


17, 


,85 


3 


16, 


,44 


3 


1, 


,0391 


n . 


. s . 


Syl labication 


11. 


,60 


3 


10, 


,77 


3 ' 




, 7794 


n. 


, s . 


Sound 


14, 


,93 


3 


12, 


,44 


3 


1, 


,6087 


n , 


, s . 


Discrimination 






















Blending 


8. 


.45 


3 


10, 


,44 


3 


1, 


,2588 


n , 


, s . 


Reading Rate 


15. 


.48 


4 


11. 


.28 


3 


1. 


.6978 


n. 


,s . 



N = 85 p, ^ . = 2.000 df = 35 



s = significant n.s. = not significant E=Experimental C^Control 

Examination of the differences between means reflects 
the advantage held by experimental groups over controls in voca- 
bulary, sound discrimination and reading rate. Controls held tlie 
advantage in blending. Overall population means reflect the 
similarity of group characteristics apparent at the time of their 
selection for program participation in the 1970-1971 school year. 
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Correct interpretation of significant difference which 
appeared in reading rate requires comi)arison of the z^euding rate 
stanine with stanine placements in other 3ub~ tests. A group median 
stanine difference of one-half stanine between rate and any sub-test 
result is generally considered significant,*^ 

Examination of the charts shows a significant difference 
between reading rate and comprehension for experimental pupils 
in the fifth grade sample and minor differences in sub-tests of 
syllabication, sound discrimination and blending. Major signi- 
ficant differences were illustrated for control pupils l)etween 
reading rate and all sub-tests according to the formula outlined 
in the rate interpretation section of the Stanford Achievement 
manual. It may be interpreted that: 

• the trend of regressive direction of reading 
deficiencies was evident at third and fifth 
grade levels for experimental and control 
pupils who were identified as in need of 
remediation procedures in tiie earlier grades 

reading needs of identified control pupils who 
did not receive the assistance from the pro- 
ject were more severe 



•^Stanford Diagnostic Reading Test, Level II. Manual for 
Administering and Interpreting. Harcourt Brace ^ World, Inc. 
1966, pg. 19. 
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A more in-depth assessment of proj^ross made during, the 
1972-1973 service j^eriod could be found tlirough cliartin.i^ average 
grade equivalent scores from pre and post pi^ogram tests adminis- 
tered to pupils in this sample. Table XIII-C presents data pertinent 
to these findings. 

The gain in grade equivalent units from pre to post- test 
period was determined to average 1.3 in vocabulary and 1.0 in 
comprcliension for second grade experimental pupils. Tiiird graders 
of the experimental group achi eved 1.2 in vocabulary and .9 in 
comprehension. Control pupils netted gains of 1,0 in vocabulary 
and .8 in comprehension (second grade level). Tliird grade controls 
demonstrated gains of .7 in vocabulary and .5 in comprehension. 
Tables Xlil-A and XIII-B present t'nc comparison of gains. 
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V . CONCLU S ION'S AND RliCOM: lliNDATlON S 
A. Discussion of Results 

Evaluation of tliis project involved a rajidomly 
selected sajnj)le of 678 pupils (355 experimental and 525 
controls). The nature of ])rogram desic;n necessitated identi- 
fication of a total population of primary pu])ils with reading 
needs. Random selection of pupils for consultant j»,roups 
within eacii j)rimary grade ])crmittod each oupil an equal 
op'portunity to be ciiusen for scn^ice. PupiJs not so selected 
were placed on a waiting list and entered the nronrain as 
replacements for trai^sferecs who withdrew from tiie sciiool 
system. 

Analysis of t'he data yielded these findinc^s: 

1 . vStatis tical ly significant differences were observed 
among the rankings of pu;)ils in terms of progress 
in reading skills between experimental and control 
pupils. 'Hie advantage w^as in favor of experimental 
groups, Teaciier ratings of items from the scale 
which were pertinent to observed reading oehaviors 
were in favor of control pupils. 

Experimental pupils ranked above control pupils 

to the degree in-.w!iich. they had upgraded their reading skills 

resulting in the ranking of the majority of these pupils in 

the ^'middle fifth^' of tiieir classes. Control pupils reflected 

more confidence and independence in classroom reading. Tiiis 

group was rated as exnibiting a more positive attitude toward 

reading . 



ERLC 



- 54 - 



2 . Graelo one jiunils norj-orincd siiTuifjcantly 
belter tuan liiira i^rnucr.s in vocabulary 
and comprehend i Oil , T; \ey laaae :)et cer use 
of c 1 a s s r o o iii in :i t e r i a 1 s a i ul received 
hi.t^her leacner inarKS . 

The influence of maturation combined with a liistory 
of unsuccessful progress through the r,radcs due to low levels 
of reading performance could contribute to consideration of 
these fiiidinqs as "expected". It must be noted that a proli- 
feration of services available within first tirade classrooms 
has provided additional support for the reading efforts of 
first graders. 

llie higiicr performances of third grade boys wliich 
were observed in word analysis, oral reading, use of compre- 
hension skills and accej)tance of reading task responsibility, 
reflected an emerging direction not seen in j)rior evaluations. 

3. Compar ison of grae 'e equivalent scores in 
comoretiension with individual pupil 

re a din g expectancies reveal ed 75 per 
cent of second e^rade t^ipils and 54 per 
cent of tiiird grade punils iiad placed 
\;itnin a half-year of their reading 
expectancies after trea tment , 

Examination of the percentages of pupils who had 
achieved the "tolerable difference" level (within .5 grade 
equivalent score units) prior to treatment was 60 per cent 
at second grade level and 16.5 per cent at third grade level. 
It must be considered that among those who achieved appro- 
priate improvement may not have been the same children who 
had acliieved this level prior to treatment. T]\e finding does 
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sug.qcst that closer scrutiny must be exercised by those who 
refer pupils to the j^ro^ram. The major reason for referral 
proved to be teacher and i)rincipal judpjnent of classroom 
performance . 1 1 becomes imj'icrative that the screejii nr^ 
process at time of referral should be refined to make certain 
that readin):^ need is documented prior to referral to the 
program. 

4. Teachers ran ked the majority of exi^erimenta 1 
pupi is wi til i it the mi dd 1 c f if tn of the i r 
classes in word analysis, sL,p.nt words, o 1 1 
read in comnreiicnsion s i > ills ana participation. 

The ranp.e was 42.8, 44.8, 41.7, 38.0 and 30.1 
on these sequences I'espectively . 

5. Parents r eported secinc^ tiieir ciiildren rcadini^ 
more books at iiome . 

Interests shown by pupils apj^arently have generated 
'in interest m reading on the part of parents. At least 6U 
per ceiU of parents stated that they had observed their child 
in reading activities at scliool. 

The results of the longitudinal study of prior 
program participants in grades four, five and six during tlie 
1972-73 school year were analyzed to determine the reading 
status of those pujuls remaining in their home schools. It 
was determined tnat the experimental pupils (prior program 
participants) now in the sixth grade, held a superior advan- 
tage over control pupils in comprehension as demonstrated by 
achieved scores from the Comprehensive Tests of Basic Skills, 
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An example of early regression effect may be exainiiiccl in the 
portion of the study which concerned itself with a saraple of 

1971- 72 second grade participants and their standings in the 

1972- 73 Comprehensive Tests of Basic Skills. The need for 
coi:tiniicd sup]K)rt in reading for identified pupils was 
evident , 
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B . Recommendations 

Recommendations based upor evaluation data findin^^s, 
parent opinions, and teacher interviews are presented. The 
recommendations suggest : 

continuation of tiie ilcadinj:; Improvement Pro j ect 

review of criteria for selection of referrals to 
the program within scl\ools 

extension of the program concept into the 
fourth grade 

continued emphasis on reading compreliension 

increased communication between the project and 
teaciiers of pu})ils being served 

continued efforts to involve parents in support 
of their cliildren^s efforts at improving reading 

implementation of program geared toward the reading 
needs of fourth grade pupils utilizing the experi- 
ental learnings and skills derived from the Reading 
Improvement Program for primary pupils. 

A key finding in this year's evaluation suggests a 
critical need for individual and grade level conferences between 
consultants and teachers in the heme schools to clarify 
questions regarding reading behaviors of specific pupils prior 
to refcri'al for the next year's program* 
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BEST COPY AVAILABLE 

APPUNDIX I 
READING IMPROVEMENT PROGRAM 

Initial Enrollment By Referral 
September, 1972 





School 




Grades 




Total 






1 


2 


3 




I. 


Bolton 


14 


37 


16 


67 


2. 


Captain Roth 


0 


32 


44 


76 


3. 


Chesterfield 


25 


41 


20 


86 


4 . 


Columb ia 


27 


21 


27 


75 


5. 


D. E. Morgan 


36 


33 


40 


109 


6. 


Dunhajii 


44 


30 


12 


86 


7. 


East Madison 


28 


41 


9 


78 


8. 


Giddings 


14 


33 


26 


73 


9. 


Gordon 


14 


30 


28 


72 


10. 


Hazeldell 


20 


30 


29 


79 


11. 


Hough 


23 


29 


32 


84 


12. 


John Burroughs 


14 


15 


13 


42 


13. 


John D. Rockefeller 


23 


15 


28 


71 


1 d 


T It W D O O 

jonn ff • rvaper 


*♦ ^ 


1 


^ o 




15. 


Joseph Landis 


13 


25 


26 


64 


16. 


Mt . Auburn 


14 


15 


46 


75 


17. 


Oliver Wendell Holmes 


0 


36 


44 


80 


18. 


Longwood 


16 


30 


31 


77 


19. 


Louis Pasteur 


13 


31 


29 


73 


20. 


Margaret Ireland 


21 


21 


43 


85 



o 
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APPl-NDIX I (Conv.'d) 

Reading Improvement, f'ror.ram ^^^1 COPY AVAILABLE 

September, 1972 



School Grades Total 







1 




3 




21. 


Mnry B. Martin 


4 


34 


22 


60 


22. 


Miles Standish 


0 


37 


34 


71 


25. 


Rosedale 


.14 


16 


45 


76 


24. 


Parkwood 


IS 


22 


38 


75 


25. 


Sowinski 


15 


23 


45 


83 


26. 


Quincy 


21 


15 


16 


52 


27. 


Stanard 


16 


16 


15 


47 


28. 


Tremont 


31 


25 


18 


74 


29. 


Wade Park 


16 


41 


23 


80 


30. 


Wash.! Hi? ton Ii'vinc 


27 


29 


13 


69 


31. 


Woodland Hills 


0 


16 


55 


71 




Non - Public 










32. 


Mt. Carmel 


8 


8 


7 


23 


33. 


St, Margaret 


0 


6 


6 


12 


34. 


St. Vitus 


IS 


16 


13 


44 




Urban Community 


14 


0 


0 


14 


36. 


Our Lp.dy of Peace 


0 


9 


6 


15 


^ / • 


St. Joseph 


U 




0 


15 


38. 


St. Catherine 


0 


11 


9 


20 


39. 


St. Coleman 


11 


8 


0 


19 


40. 


St o Hyacinth 


0 


8 


6 


14 


41. 


Our Lady of Lourdes 


0 


5 


4 


9 






613 


9.1 4 


953 


2,480 
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APPIiNDIX IV 



School 



Pupil Ratini; Sheet 
Reading Instruction Progrc 



BEST COPY AVAILABLE 

Check One: 
Experimental | \ 

Control [ j 

Project Reach [ | 



Reading 
Improvement 



Talking 
Typc\vTiter | | 



:im - 1975 



^ has been receiving services of 

the Readirig Instruction Fro};ranu We are interested in securing 
from you, his classroom tcaciier, ratings and pertinent infurniation 
about his readin,^^ performance. Please complete, t:heck and return 
ti'ic completed form in the enclosed envelope sealed to the consul- 
tant in your building. Ml sealed envelopes are to be returned to 
the Division of Research and Development, attention Juanita Logan, 
Room 605, no later tlian Juno 10; 1974. 



1* I idicate latest scholastic aptitude test result. 

*MR PLR IQ 

Test 



2. Child^s birthdate 



Month 



Day 



Year 



6/74 



Present grade level 



In September 



4. Child's annual attendance (add both semesters) 



5. Reading mark assigned 



^Metropolitan Reading Readiness Test - Letter Rating 



ERLC 
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BEST COPY AVAILABLE 

6. Use child's reading card: 

How many reading steps did the child complete in 1971-72? 

How many steps did the child complete in 1972-73? 



7. In your opinion can this cltild handle the usual reading material 
for his grade level? (Disretrard numbers. Check the box only.) 



I I Always j 1 Most of the time | | Sometimes 
5 4 3 



I j Rarely | | Not at all 
2 1 

8, In general, have you noted any degree of improvement in: 

Not Very Doesn't 

At Al l Some Much Apply 

a. Pupil participation in group work 

Completion of reading assignments 

c. Pupil confidence in J)is ability 

to read 

d. Pupil independence in reading 

study skills 

e. Pupil ' 5 general attitude toward 

school 
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BEST COPY AVAILABLE 



9. From your knowiodgc of tliis i^upil's work in your classroom, how 
would you rank this choUPs reading performance as described 
below in relation to the other children in your class. 
(Visualize your class as being divided into fifths.) 



Number of pupils in class 



Rank in Class 



(Please C!heck) 

a. recognizing consonant soun^ 

b , recognii: inn vowel sounds 


Lowest 
1/5 


Second 
Lowest. 
1/i^ 


.Middle 
1/5 


Second 
Highest 
1/3 


'lop 
1/3 


s 
























c, identifying sight words 
for rjrade level 












d. pronouncing words at grade 

level 

e. reading crally witliout 

undue frustration 






















f. finding main ideas 

g. following seouei^ce 






















h. getting meaning of words 

from context 

i. recognizing di.rcctly 

stated detai Is 






















j, drawing conclusions from 
facts or statements 

k. participating in reading 
group 




















• 


1. completing written 
assignments 
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BEST copy AVAILABLE 

APPliNDIX V 
CLBVliLANl) PUBLIC SCHOOLS 
Reading Improvement Program 

Dear Parent : 

We are contacting parents who have youngsters who have been parti- 
cipating in the Reading Improvement Program here at School. 



Would you please help us by telling us what you thii\k about this program? 

1. Do you have a son or daughter in this program? Son ^Daugliter 

2. In what grade is your youngster? 

3. Has the proj;ram helped your child? 

f^ot at All Very Lictlo ^Some Very Mucli 

4. What does your child say about the program? 

5. Have you noticed that ycur child reads more books at home? ^Yes No 

6. Have you noticed that your child takes more books from the library? 

Yes Wo 

7. How did you find out your child was in this program? 

Letter Child Said ^Teaclier Called Other 

8. What's tho best thing about the program? 

9. Has the program helped you to lielp your child in reading? Yes No 

If yes, how? 

10, Do you feel the program should be continued? 

11. What changes should be made in the program? 



ERIC 



- 71 - 



BEST COPY AVAILABLE 



12, Have you visited the school? 



Please return this form in the sealed envelop to your child ^s 
teacher who will return it to Mrs. Juanita Logan, Room 610, 
Division of Research and Development, 



Thank you, 



Pauline S, Davis 
nducational Pro?.ra!u Manager 
Reading; Instruction Program 
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APPhNUIX VI 
SUMMyM^.Y OF COMI'AIUSONS 
lixperimeatal -- Control 





Least Squares 




Probability 


Variable 


Lis uiinates 


F-ratio 


Level 


Word Analysis 


.17927 


.5283 


.4676 


Sight Words 


.27588 


.7945 


.5752 


Oral Reading 


.62554 


9.4114 


.0023 


Con^pre])en5ioi\ Skills 


. 51861 


.0004 


.9365 


Task Responsibility 


. 55265 


.8024 


.5707 


Classroom Materials 


.54582 


2.9414 


.0869 


Teacher Mark 


.26809 


3.5014 


.8920 


Participation 


,2SSS3 


.0185 


.3907 


As s i g niTien t s Comp 1 c t od 


.48910 


. 7380 


.0213 


Confidence in Reading 


.07884 


5 .5555 


.3541 


Independence 


.15210 


.8602 


, 5655 


Attitude 


.45011 


.8269 


.8860 



F-ratio for Multivariate Test of Analysis of Covariance = 1.9070 
D.F. = 18 and 644 p less than .0152 



BEST COPY AVAILABLE 



APPENDIX VI (Cont'd) 
SUi'L'.lARY OF COMPARISONS 
Boys — Girls 





Least Squares 




i 


^j.'obability 


Variable 


Iistimatcs 


P-i 


•atio 


Level 


Word Analysis 


.26767 


11. 


34 25 


.0009 


Sight Words 


.26892 


1. 


4088 


.2357 


Oral Rcadinp 


.28241 




0717 


.7889 


Conijirelicns ioi\ Ski] Is 


.20573 




6598 


vir/o 


Tas k I^e s po ns i b i i i t y 


.36324 


4. 


6974 


.0306 


Classroom iMaterials 


-.25659 


1. 


84 79 


.174 5 


Teacher Mark 


-.13676 




0347 


.8523 


Participatioi\ 


-.1S752 




1637 


.6860 


Assignment C o r?.r. i e t i o n 


-.34166 


1. 


6519 


.1992 


Confidence in ileading 


-.18795 




9023 


.3426 


Indpencdence 


-.26544 




6988 


.4035 


Attitude 


1.18729 


1. 


9565 


.1624 


F-ratio for Multivariate 


Test of Analysis 


of 


Covariance = 


^ 4.4595 


D.F* = 18 and 644 p less 


than .0001 
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APPENDIX VI (Cont'd) j 

? 

SUMMARY OF COMPARISONS ' 

Grade 1 - Cradc 5 
Gradtj 2 - Grade 3 







Least 


Squares 








Pro'oa 


u 11 i tv 


Variable 




estimates 




F- 


ratios 


Level 




Gi 


\ 1-3 


Gr. 2-3 


Gr. 


1-3 


Gr. 2-5 


Gr. K3 


Gr. 2~, 


Word Analysis 


-1. 


26751 


-.40U5S 


7. 


440S 


3.2870 


.0066 


.0703 


Sight IVords 


-1. 


46359 


-.47260 


5 . 


7703 


,7281 


.016b 


,3939 


Oral Readinj? 


-1. 


46112 


- .37257 


n 


7186 


.5512 


.0997 


.5537 


Comprehension Skills 


- 1. 


5S794 


-.47715 


2 


6752 


3.9464 


.1025 


.0474 


Task Responsibility 


-1 . 


53608 


-.49825 




4475 


2.1399 


.503S 


. 1440 


Classroom Materials 


1. 


8S159 


.47284 




0576 


5.1269 


.8464 


.0239 


Teaciier Max^k 




90320 


.29759 




2735 


.4625 


.6012 


.4968 


Participation 


1. 


07618 


,454 39 




4417 


1.6532 


.5066 


. 1990 


Assignments Completed 


1 . 


17525 


.56941 




5506 


2.9607 


.5540 


.0853 


Confidence in Reading 


1. 


U4S27 


.35152 




3171 


7.4520 


.5756 


.0066 


Independence 


1. 


07391 


.40520 




0558 


.5945 


.8135 


.4410 


Attitude 


1. 


1S729 


.56202 


2. 


7638 


5.9584 


.0969 


.0250 



F-ratio for Multivariate Test of yXiialysis of Covariancc = 11S.7995 
D.F. = IS and 644 p less than .0001 
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^\ppmnx VII 

Mli.VN SCHOLASTIC APTITUDli 
Levels v)f Sigiiif icance 
Grades 1 , 2 And 5 
Hxperiuiontal Vs . Control 
1972- rJ75 Sample 



Group 



Decrees Of 



Gracl 


c 


Sex 


;\' 


Mean 


rreedoiii 


t 


Decision 


1 


H 


B 


59 


84.52 










C 




40 


78.75 


97 


2.4280 


s. 




E 


G 


29 


77.55 










C 




21 


75.47 


48 


1.54S6 


U.S. 


2 


L 


B 


67 


82.26 










C 




75 


80.40 


140 


1,1588 


n. s . 




H 


G 


61 


80.06 










C 




52 


79.19 


111 


.5952 


n. s . 


3 


H 


B 


78 


89.67 










C 




88 


90.28 


164 


.3651 


n.s. 




E 


G 


61 


87.09 










C 




67 


89.29 


106 


1.0803 


n. s. 



p. ^ .05, d.f. 97 = 2.000; d.f. 48 = 2.021; d.f. UO = 1.980 
d.f. 111 2.000; d.f. 164 = 1.980; dj". 106 = 2.000 



Experimental C - Control s - Significant n.s. -not significant 
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AJTiiNUIX VIU 

PARTIAL MATRIX 01- CORRHLATIONS 
Willi COVARIATIiS ULIMINATED 



Variabl e liiussroom !iacerial leaciicr Mark 

Classroom Materials 1,000000 

Teacher Mark *4Sy613 1.000000 

Participation ,510287 .29756^1 

Assigaracin: Conii)lction ,540464 .552831 

Confidence in Reading .610753 .378245 

Independence ,615045 .592358 

Attitude ,455207 .269016 
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